2.16.1: plan-mode receipts, and a bound on what a receipt may cost - #94
Merged
Conversation
Plan mode was the one candidate the 2026-09-02 audit named for why methods go unread in long installed sessions. Eleven isolated sessions on exact v2.16.0, plan mode the only variable, refute it: all eleven opened delegation before their first spawn and all eighty-nine spawns named a level, and the only asymmetry favours plan mode. The pass cost fifty-one sessions and $165 to settle one yes-or-no question while the four sessions carrying the answer cost under six dollars, so AGENTS.md now bounds a receipt: name the observable and stop when it lands, pilot one session per arm and run one more, keep one fixture, cap spend and sessions in flight, and give every run its own fixture directory and log. It also records that disabling the setting sources does not stop a session from reading the maintainer's instruction files with a shell command. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Documentation and receipts. The shipped instructions under
plugins/skiphow/are byte-identical to 2.16.0; nothing a project installs behaves differently.What this settles
The 2026-09-02 dogfood audit of two installed CI-cost sessions named one candidate for why methods go unread in long installed sessions: both began in plan mode, whose host reminder opens by telling the run to dispatch Explore agents in parallel with the agent type already chosen. Eleven isolated sessions on exact unmodified
v2.16.0, plan mode the only variable, show the two arms behaving identically — all eleven openeddelegationbefore their first spawn, and all eighty-nine spawns named a level. The only asymmetry favours plan mode, which openedexecution-healthin four of its six sessions and none of the five without.Because the clean fixture never reproduced the failure, this bounds plan mode as a sole cause, not as one term in an interaction. The cause stays
UNVERIFIEDand no candidate replaces it. The audit's own recommendation — change nothing in the package — is followed.What changed
AGENTS.mdnow bounds what a receipt may cost. This pass spent forty sessions across fifty-one invocations, $165 and nearly five hours on one yes-or-no question, while the four sessions that carried the answer cost under six dollars between them. Name the observable and stop when it lands; pilot one session per arm and run one more; keep one fixture and fix an unproductive prompt from the record rather than by running another batch; cap spend and sessions in flight; give every run its own fixture directory and log.It also records that disabling every setting source keeps the maintainer's own instruction files out of a session's context but does not stop the session from reading them with a shell command — one run in this pass did exactly that fifteen seconds in, and was voided.
Checks
python scripts/check.pypassed,git diff --checkclean.scripts/check_hosts.py: Claude package validation and isolated install PASS; CodexUNVERIFIED(no Codex validator on this machine).UNVERIFIED.🤖 Generated with Claude Code